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Shifted Matroid Optimization 


Asaf Levin * Shmuel Onn ^ 


Abstract 

We show that finding lexicographically minimal n bases in a matroid can be done in 
polynomial time in the oracle model. This follows from a more general result that the 
shifted problem over a matroid can be solved in polynomial time as well. 
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1 Introduction 

Let G be a connected graph and let n be a positive integer. Given n spanning trees in G, an 
edge is vulnerable if it is used by all trees. We wish to find n spanning trees with minimum 
number of vulnerable edges. One motivation for this problem is as follows. We need to 
make a sensitive broadcast over G. In the planning stage, n trees are chosen and prepared. 
Then, just prior to the actual broadcast, one of these trees is randomly chosen and used. 
An adversary, trying to harm the broadcast and aware of the prepared trees but not of the 
tree finally chosen, will try to harm a vulnerable edge, used by all trees. So we protect each 
vulnerable edge with high cost, and our goal is to choose n spanning trees with minimum 
number of vulnerable edges. 

Here we consider the following harder problem. For A: = 1,..., n, call an edge k-vulnerable 
if it is used by at least k of the n trees. We want to find n lexicographically minimal trees, that 
is, which first of all minimize the number of n-vulnerable edges, then of (n — l)-vulnerable 
edges, and so on. More precisely, given n trees, define their vulnerability vector to be / = 
(/i,..., fn) with fk the number of /c-vulnerable edges. Then n trees with vulnerability vector 
/ are better than n trees with vulnerability vector g if the last nonzero entry of <7 — / is 
positive. (We remark that this order is often used in the symbolic computation literature, 
where it is called reverse lexicographic, but for brevity we will simply call it here lexicographic.) 
As a byproduct of our results we show how to find in polynomial time n lexicographically 
minimal spanning trees, which in particular minimize the number of vulnerable edges. 

This problem can be defined for any combinatorial optimization set as follows. For matrix 
x G let be its j-th column. Define the n-product of a, set S C by 

;= XnS := {xGR'^''” : G 5 , j = 1,..., n} . 

‘Technion - Israel Institute of Technology, Haifa, Israel. Email: levinas@ie.technion.ac.il 
^Technion - Israel Institute of Technology, Haifa, Israel. Email: onn@ie.technion.ac.il 


1 



2 


Call two matrices x,y ^ equivalent and write x ~ 7/ if each row of x is a permutation 

of the corresponding row of y. The shift of matrix x G is the unique matrix x G 

which satishes x ~ x and x^ > • • • > x"", that is, the unique matrix equivalent to x with each 
row nonincreasing. Let |x-^| := Yli=i |x| := Yl^=i be the sums of absolute values 

of the components of and x, respectively. The vulnerability vector of x G {0,is 

We then have the following nonlinear combinatorial optimization problem. 

Lexicographic Combinatorial Optimization. Given S C {0, and n, solve 

lexmin{(|x^|,..., Ix^^l) : x G S^} . (1) 

The complexity of this problem depends on the presentation of the set S. In [7] it was shown 
that it is polynomial time solvable for S = {z G {0, l}'^ : Az = 6} for any totally unimodular 
A and any integer b. Here we solve the problem for matroids. 

Theorem 1.1 The lexicographic combinatorial optimization problem dll) over the bases of any 
matroid given by an independence oracle and any n is polynomial time solvable. 

Our spanning tree problem is the special case with S the set of indicators of spanning trees 
in a given connected graph with d edges, and hence is polynomial time solvable. 

We note that Theorem 11.11 provides a solution of a nonlinear optimization problem over 
matroids, adding to available solutions of other nonlinear optimization problems over matroids 
and independence systems in the literature, see e.g. mEiEii and the references therein. 

We proceed as follows. In Section 2 we discuss the shifted combinatorial optimization 
problem and its relation to the lexicographic combinatorial optimization problem. In section 
3 we solve the shifted problem over matroids in Theorem 13.41 and conclude Theorem ll.il In 
Section 4 we discuss matroid intersections, partially solve the shifted problem over the inter¬ 
section of two strongly base orderable matroids (which include gammoids) in Theorem 14.31 
and leave open the complexity of the problem for the intersection of two arbitrary matroids. 
We conclude in Section 5 with some final remarks about the polynomial time solvability of 
the shifted and lexicographic problems over totally unimodular systems from [7], and show 
that these problems are NP-hard over matchings already for n = 2 and cubic graphs. 

2 Shifted Combinatorial Optimization 

Lexicographic combinatorial optimization can be reduced to the following problem. 

Shifted Combinatorial Optimization. Given S C {0, and c G solve 

maxjcx : x G 5”} . (2) 

The following lemma was shown in [7]. We include the proof for completeness. 

Lemma 2.1 ^ The Lexicographic Combinatorial Optimization problem dB) can be reduced 
in polynomial time to the Shifted Combinatorial Optimization problem m- 
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Proof. Define the following c G and note that it satisfies c = c, 

dj := -{d + iy~^, i = l,...,d, j = l,...,n. 

Consider any two vectors x,y £ S'^, and suppose that the vulnerability vector (|x^|,..., |x"|) 
of X is lexicographically smaller than the vulnerability vector (|y^|,..., \y^\) of y. Let r be 
the largest index such that \3f\ ^ |y’’|. Then \y‘^\ > |x’'| + 1. We then have 

n 

Y^{d + iy-Wyy-\xy) 

i=i 

Y^{d+iy-^{\w\-\xy) + {d+ir-^ 

j<r 

{d + iy-^ -Y,d{d + iy-^ > 0. 

j<r 

Thus, an optimal solution x for problem ([2]) is also optimal for problem ([T]). □ 

We proceed to reduce the Shifted Combinatorial Optimization problem ([5|) in turn to two 
yet simpler auxiliary problems. For a set of matrices U C {0, let [U] be the set of 

matrices which are equivalent to some matrix in U, 

[U] := : 3 y £ U, x ^ y} . 

Consider the following two further algorithmic problems over a given S C {0, l}*^: 

Shuffling. Given c £ solve maxjca: : x £ [5’’^]}- (3) 

Fiber. Given x G [5”], find y £ S'^ such that x y. (4) 

Lemma 2.2 The Shifted Combinatorial Optimization problem ([2]) can he reduced in polyno¬ 
mial time to the Shuffling and Fiber problems ([3]) and m- 

Proof. First solve the Shuffling problem ([3]) with profit matrix c and let x £ [S'’*] be an 
optimal solution. Next solve the Fiber problem Q for x and find y £ S"^ such that x ~ ?/. 
We claim that y is optimal for the Shifted Combinatorial Optimization problem ([2]) . To prove 
this, we consider any z which is feasible in (l2|), and prove that the following inequality holds, 

cy = cx > cx > cz . 

Indeed, the first equality follows since x ~ y and therefore we have y = x. The middle in¬ 
equality follows since c is nonincreasing. The last inequality follows since z £ S'^ implies that 
z G [S’*] and hence z is feasible in ([3]). So y is indeed an optimal solution for problem ([2]). □ 


cx — cy = cx — cy = 

> 

> 
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3 Matroids 

Define the n-union of a set S C {0,1}^ where E is any finite set to be the set 

n 

WnS := {x € {0,1}^ : 3xi,. .., G S', x = ^ Xk} ■ 

k=l 

Call S C {0,1}^ a matroid if it is the set of indicators of independent sets of a matroid 
over E. We will have matroids over E = [d] := {1,... ,(i} and E = [d] x [n]. The following 
facts about n-unions of matroids are well known, see e.g. m- 

Proposition 3.1 For any matroid S and any n we have that VnS is also a matroid. Given 
an independence oracle for S, it is possible in polynomial time to realize an independence 
oracle for VnS, and if x G VnS, to find xi,... ,Xn G S with x = ^k- 

Define the n-lift of a set of vectors S C {0, l}*^ to be the following set of matrices, 

n 

tnS := {xG{0,l}'^^^ : ^x^ gS}. 


We need two lemmas. 

Lemma 3.2 For any set S C {0,1}'^ and any n we have that [S”] = V„, fnS in {0 ,. 

Proof. Consider x G [S”]. Then x ~ y for some y G S'^, and thus y^ G S for j = 1,... ,n. 
Since x ~ y, each row of x is a permutation of the corresponding row of y. Assume that 
the i-th. row of x is given by the permutation TTj of the corresponding row of y. That is, 
Xi,j = For k = 1,... ,n, we define a matrix Zk G {0,whose column sum satisfies 

Yl]=i^k = by {^k)i,j := Xij if -Ki{j) = k, and otherwise izk)i,j := 0. Since y^ G S, we 
conclude that Zk Gfn S. Since the supports of the Zk are pairwise disjoint, we have that 
G Vn tn S. However, ^k = xhj definition, and thus x GVnfn S. 

In the other direction, assume that x G tn S. Then there are xi,...,x„ Gfn S 
such that X = Ylk=i^k- That is, there are xi,...,Xn G {0,1}'^^” such that for each 
k = l,...,n, we have ^ S, and x = Yl'k=i^k- Let y be a matrix whose A:-th 

column is y^ = xj.. Then y^ G S, and therefore y G S^. The matrices x and y are 0 — 1 

matrices and YlJ=i x^ = ^ therefore x ~ y. Thus, x G [S'”], as required. □ 


Lemma 3.3 Let S C {0, he a matroid given by an independence oracle. Then we have: 
1- tnS C {0,1}'^^” is also a matroid, for which an independence oracle can be realized. 

2. The rank of the matroid tnS equals to the rank of the matroid S. 

3. The rank of the matroid [S”] = tn S equals n times the rank of the matroid S. 
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Proof. We begin with the first claim. Let 2 ; be the 0 matrix (where Zij = 0 for all i,j). Then 
is the zero vector that belongs to S since S' is a matroid, and therefore 2 : S. Let 

X > y be a pair of 0 — 1 matrices such that x Gtn S. Let x = Yl'j=i j V ~ ■ 

Then x > y. Since x GfnS, x € S, and because S is a matroid y € S, and thus y GtnS. Last, 
assume that x,y Gtn'S' and \x\ > |y|. Let x = V ~ Since |x| > |y| we 

conclude that \x\ > \y\. Since x,y Gf^, S, x,y & S and since S is a matroid there is i such 
that Xi = 1, iji = 0 and changing iji to 1 results in an indicating vector of an independent set 
of S. Consider this value of i, and let j be such that Xij = 1. Then, by changing to 1, 
we get a larger matrix whose column sum is the vector resulted from y by changing its i-th 
component to 1, and thus the new matrix is in fnS. Therefore, is a matroid. To present 
an independence oracle of fn S, assume that we would like to test the independence of a 0 — 1 
matrix x, then we compute Yl]=i test if the resulting vector is independent in S. 

Next we show the second claim. Let x be an indicating matrix of an independent set of 
the matroid fn S, then its column sum is in S and its rank in S equals to the rank of x in 
tn S. In the other direction, let x G S'. Define a matrix x whose first column is x and its all 
other columns are zero columns, then = x € S, and therefore x Gtn S. The rank of 

X in t^S* equals the rank of x in S, and thus the claim follows. 

Last, consider the remaining claim. Given a matroid T it is always the case that the rank 
of the ground set according to V„T is at most n times the rank of the ground set according 
to T. Thus, to show the claim using the second claim, it suffices to show that given a base 
z of S, there is an independent set of tn S whose rank (in tn S) is n times larger 
than the rank of z (in S). With a slight abuse of notation, assume that z is the indica¬ 
tor of the base z. Let x be a matrix such that for j = 1,... ,n, x^ = z. Then x G S^, 
and therefore it is an indicator of an independent set of tn S whose rank is |x| = n|z| 
that equals n times the rank of the base z (according to the rank function of the matroid S). □ 


Theorem 3.4 The shifted combinatorial optimization problem ([2]) over any matroid given by 
an independence oracle or over its set of bases and any n is polynomial time solvable. 

Proof. We begin with the problem over (the independent sets of) a matroid S. Consider 
problem ([3]) over S. Since [5”] = V„ tnS* by Lemma [321 h follows from Proposition 13.11 and 
Lemma 13.31 that [5"'] is a matroid for which we can realize an independence oracle. So the 
greedy algorithm over solves problem ([3]) over S. Next consider problem (|3]) over S. Let 
X G [S'”] be given. By Proposition 13.11 and Lemma 13.21 and Lemma 13.31 again, we can find 
xi,...,x„ GtnS with X = Ylk=i Let y be the matrix with y^ = Yl'j=i xl. for k = 1,... ,n. 
Then 

n n n n n n 

= 'Ey’'■ 

j=l j=l k=l k=l j=l k=l 

This implies that x ~ y. Now, since Xk GtnS and y^ = Yl'j=i have that y^ ^ S for all 

k. So we can find y G S"" with x ~ y and therefore solve problem ([5]) over S as well. It now 
follows from Lemma 12.21 that we can indeed solve problem ([2]) over S. 

To solve problem ([2|) over the set of bases of S proceed as follows. Define a new profit 
matrix w by Wij := Cij + 2|c| -|- 1 for all i,j. Solve problem ([3]) over (the independent sets of) 
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S with profit w by the greedy algorithm over Let r be the rank of S so that by Lemma 
13.31 the rank of [S'""] is nr. Consider any x,y,z G [S'""] with x, y bases and z not a basis. Then 

wx = cx + (2|c| + l)|x| = cx + (2|c| + l)nr > —|c| + (2|c| + l)nr , 

wz = cz + (2|c| + 1 )| 2 ;| < |c| + (2|c| + l)(nr — 1) . 

So wx — wz > 0 and hence the tc-profit of any basis x is larger than that of any independent 
set 2 ; which is not a basis, so the algorithm will ontput a basis. Also, wx — wy = cx — cy and 
hence the rc-profit of basis x is larger than that of basis y if and only if the c-proht of x is larger 
than that of y, so the algorithm will output a basis x of [5”] with largest c-proht. Now solve 
problem Q and hnd y G S'^ with x ~ y as before. Since S has rank r, each column y^ G S 
satishes \y^\ < r. Since nr = |x| = |y| = Ylk=i \y^\ must have in fact \y^\ = r so that 
y^ is a basis of S for all k. Therefore y is an optimal solution for problem ([2|) over the bases. □ 

Proof of Theorem \l.ll This follows at once from Lemma 12.11 and Theorem 13.41 □ 


4 Matroid Intersections 

We next consider the Shifted Combinatorial Optimization problem over matroid intersections. 
We can only provide a partial solution for the class of strongly base orderable matroids, 
introduced in [3], which strictly includes the class of gammoids, see [IHl Section 42.6c]. 

Let S C {0,1}^ be a matroid and let B be the set of subsets of [d] which are supports of 
bases of S. Then S is strongly base orderable if for every pair Bi, B 2 G B there is a bijection 
vr ; i?i —)■ i ?2 such that for all I C. Biwe have 7r(/)U(i?i\/) G B (where vr(/) = {'x{i) : i G /}). 
We need the following elegant result of [5], see also [TOl Theorem 42.13]. 

Proposition 4.1 For any two strongly base orderable matroids Si and S 2 we have 

{ynSi)r\{ynS2) = v„(5inS2) . 

We also need the following lemma. 

Lemma 4.2 If S is a strongly base orderable matroid, then fn S is also a strongly base 
orderable matroid. Further, for any 81,82 C {0,1}'^ we have that tn'S’iC tn<S '2 =tn (5'i PI 82 ). 

Proof. We begin with the first part. Let 5* be a strongly base orderable matroid. Then by 
Lemma [T3l fn 8 is also a matroid. Let x,y G {0,1}'^^’^ whose supports X, Y are two bases of 
tn 8 . By Lemma [331 the supports X and T of x = Yl^=i y = respectively are 

two bases of 8 . Since S' is a strongly base orderable matroid there is a bijection vr : A —)• T 
snch that 7 r{I) U {X \ I) is a base of 8 for every I C X. We define a bijection tt' : X ^ Y 
as follows. For every (i,j) G X, we let 7r'(z,j) = (7r(i),j') where j' is the unique column 
containing 1 in the 7r(i) row of y (there is snch a column as 7r(i) gY). A support of a 0 — 1 
matrix is a base in fn 8 if and only if its column sum is a base in 8 . Thus, the required 
properties of vr' follow from these properties of vr. 
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Next we prove the second claim. Let x Gtn •S’lLl tn S 2 and denote its column sum by 
X = ■ Since x StnS'i, we have x G Si, and similarly since x GtnS2, we have x G S2. 

Thus, X G Si n S 2 , and thus x Gfn (Si n S 2 ). In the other direction, let x Gtn (Si fl S 2 ) and 
denote x = ■ Then, x G Si n S 2 . Thus, x G Si, and therefore x GfnSi, and similarly 

X G S2, and therefore x GtnS2. Therefore, x GtriSifl tnS2. □ 


Theorem 4.3 The optimal objective function value of the shifted combinatorial optimiza¬ 
tion problem m over the intersection of any two strongly base orderable matroids given by 
independence oracles and any n can be computed in polynomial time. 

Proof. Let Si,S 2 C {0, be strongly base orderable matroids and let S := Si D S 2 . By 
Lemma W?2{ fn Si and fn S 2 are strongly base orderable matroids. Applying Proposition 14.11 
to tnSi, tnS 2 , and using Lemmas 13.21 and 14.21 we get 

[S^] n [S2"] = (V„ tnSi) n (V„ tnSa) = V„(tnSin tnS2) = v„ tn (Si n S2) = [S’^] . 

By Proposition 13.11 applied to the matroids tn Si and tnS 2 , and using Lemma (3^ we can 
realize in polynomial time independence oracles for [Sf] and [S2]. So we can maximize a 
given profit matrix c over [S”] by maximizing c over the intersection of the matroids [Sf ] and 
[S2]. This solves problem ([3]) over S and gives the optimal value of the shifted optimization 
problem ([2|) over S via the equality max{cx : x G S”} = max{cx : x G [S”]}. □ 

We raise the following natural questions. Is it possible to actually find an optimal solution 
(and not only the optimal value) for the shifted problem over the intersection of strongly base 
orderable matroids in polynomial time? What is the complexity of shifted combinatorial 
optimization over the intersection of two arbitrary matroids? 

The answer to the hrst question is yes for transversal matroids since then the Fiber problem 
Q over the intersection can also be solved. This implies in particular that the shifted problem 
over matchings in bipartite graphs is polynomial time solvable. However, if the Fiber problem 
cannot be solved efficiently, that is given x G [S'**], it is hard to find y G S'” such that x ~ y, 
then there are matrices c for which it is hard to solve the Shifted Combinatorial Optimization 
problem as well. To see this, let c be such that for all i,j we have Cij = 1 if Xij = 1 and 
Cjj = —1 if Xij = 0. Then, the optimal profit will be |x|, and every optimal solution y to 
the Shifted Combinatorial Optimization problem must satisfy y G S'” and y ~ x, and thus 
solves the Fiber problem as well. Thus, the Fiber problem is not harder than the Shifted 
Combinatorial Optimization problem. 


5 Remarks 

It was shown in [7] that problem (l2|) and hence also problem ([T|) are polynomial time solvable 
for S' = {z G {0,1}'^ : Az = 6} with A totally unimodular and b integer. We briefly give a 
new interpretation of this by showing how the new auxiliary problems ([3|) and dH over such 
S can also be efficiently solved, so Lemma YI?2\ can be applied. 


Proposition 5.1 For S' = {z € {0, 1}'^ : Az = b} with A totally unimodular and b integer, 

n 

[S^] = {x G {0,: Aj2x^=nb}. (5) 

i=i 

Moreover, problems ([3]) and ([4]) hence m and (HD over S are polynomial time solvable. 

Proof. If X is in the left hand side of (l5|) then there is a y G S*^ with x ~ y. Then 
A = A = nb so X is also in the right hand side. If x is in the right hand side, 

then a decomposition theorem of [1] implies that there is a y G S"" with ■ 

Then x ~ y so x is also in the left hand side of ([5]). Moreover, by an algorithmic version of 
[7] of this decomposition theorem, such a y can be found in polynomial time, solving problem 
dH) over S. By the equality in ([5]), to solve problem ([3]) over S with a given profit c, we can 
maximize c over the right hand side of ([S]), and this can be done in polynomial time by linear 
programming since the defining matrix of this set is \A,...,A\, which is totally unimodular 
since A is. Lemmas 12.11 and 12.21 now imply that problems (l2|) and © over S can also be 
solved in polynomial time. □ 

This in particular implies that lexicographic combinatorial optimization over s — t paths 
in digraphs or perfect matchings in bipartite graphs is polynomial time doable. 

The shifted combinatorial optimization problem over S C {0, l}'^ in the special case n = 1 
is just the standard combinatorial optimization problem max{cx : x G S'} over S. So a solution 
of the former implies a solution of the latter. Is the converse true? The above results show 
that it is true for matroids, certain matroid intersections, and unimodular systems including 
s — t paths in digraphs and perfect matchings in bipartite graphs. Unfortunately, as we next 
show, the answer in general is negative. 

Proposition 5.2 Let S C {0, be the set of perfect matchings in a cubic graph. Then the 
lexicographic problem © and shifted problem ([2]) over S are NP-hard already for fixed n = 2. 

Proof. By Lemma 12.11 it is enough to show that solving lexmin{(|x^|, |x^|) : x G is 

NP-hard. We claim that deciding if there is an x G S'^ with |x^| = 0 is NP-complete. Indeed, 
there is such an x if and only if there are two edge disjoint perfect matchings in the given 
graph. Now this holds if and only if there are three pairwise edge disjoint perfect matchings 
in the given graph, since it is cubic. This is equivalent to the existence of a 3 edge coloring, 
which is NP-complete to decide on cubic graphs [6]. □ 

We point out that the set of perfect matchings in a graph can be written in the form 
S' = {z G {0, 1}'^ : Az = 6} with A the vertex-edge incidence matrix of the graph and b the 
all 1 vector in the vertex space. Thus, Proposition 15.21 shows, in contrast with Proposition 
EH that if A is not totally unimodular, then the shifted problem is NP hard over such sets S, 
even if we can efficiently do linear optimization over S, as is the case for perfect matchings. 

The shifted optimization problem maxjcx : x G S'”} can be defined for any set S C Z'^, and 
its complexity will depend on the structure and presentation of S. Consider sets of bounded 
cardinality. Note that even with |S'| = 2, the number of feasible solutions is |S'”| = 2”, so 
exhaustive search is not polynomial. However, we do have the following simple statement. 
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Proposition 5.3 For any fixed positive integer s, the shifted optimization problem over any 
set S satisfying |S| < s, any n, and any c € ean be solved in polynomial time. 

Proof. Let S = {z^,..., z™} be the list of elements of S, with m < s and z* G for all i. 
Given x G let n* := \{k : = z*}| for i = 1,..., m. Let y G S’"" be the matrix with first 

ni columns equal to z^, next n 2 columns equal to z'^, and so on, with last Um columns equal 
to 2 ™'. Then y ~ x (in fact, y is obtained from x by applying the same permutation to each 
row), and therefore cx = cy. So the objective value of x can be computed from ni,..., Um. 
Now, any integers 0 < n* < n with ni = n give a feasible y ^ with these counts. 

So, it is enough to go over all such ni,..., n^, for each compute the corresponding y and the 
value cy, and pick the best. The number of such tuples is at most (n + 1)™“! = 
since Um = n — is determined by the others, which is polynomial in n for hxed s. □ 
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